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Abstract 

A Markovian dichotomic system driven by a deterministic time-periodic force is 
analyzed in terms of the statistical properties of the switching events between the 
states. The consideration of the counting process of the switching events leads us 
to define a discrete phase. We obtain expressions for the instantaneous output fre- 
quency and phase diffusion associated to the dichotomic process, as well as for their 
cycle averages. These expressions are completely determined by the rates of escape 
from both states. They are a convenient starting point for the study of the stochas- 
tic frequency and phase synchronization in a wide range of situations (both classical 
and quantum) in which two metastable states are involved. 
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1 Introduction 



The phenomenon of synchronization in stochastic systems has attracted much 
interest in recent years [1,2,3,4,5,6,7]. In the case of a periodically driven 
bistable stochastic system, it has been shown to be particularly useful to 
introduce a discrete phase associated to the output signal [1,2,5,6]. Then, the 
synchronization between the periodic input signal and the stochastic output 
signal is characterized in terms of certain quantities as, for example, the av- 
erage output frequency and the average phase diffusion. Noise regulates the 
input-output synchronization in such a way that the value of the average 
output frequency might match the value of the input frequency for a range 
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of noise strength values. Furthermore, even though the output phase is a 
stochastic quantity, it is characterized by a diffusion coefficient with a sharp 
minimum for values of the noise strength where frequency locking exists. Noise 
induced synchronization is one of the diverse type of phenomena arising from 
the interplay between nonlinearity and noise in systems externally driven by 
time-periodic forces. Stochastic resonance [8,9,10,11,12,13,14,15] and Brown- 
ian motors [16,17,18,19] provide other instances of this rich phenomenology. 

In this paper we focus on the calculation of explicit expressions for the in- 
stantaneous output frequency and phase diffusion, as well as for their cycle 
averages. We restrict our study to the case of a Markovian two-state system, 
driven by an arbitrary deterministic time-periodic force, in contrast to Ref [1], 
where only dichotomic forces are considered. In our analysis, we do not specify 
the underlying continuous dynamics which leads, by contraction, to the two- 
state description. In this sense, our results can be applied to the study of the 
stochastic frequency and phase synchronization in a wide range of situations 
(both classical and quantum), whenever the system presents two metastable 
states and the contracted two-state dynamics is (approximately) Markovian. 
As it has been shown elsewhere [20], in the case of a rocked overdamped 
bistable stochastic system, such a situation takes place in the weak-noise and 
low-frequency limit. 

The paper is organized as follows: We begin with a description of the Marko- 
vian two-state model in terms of the switching times and define the discrete 
phase associated to this dichotomic process. Subsequently, in Sect. 3, we ana- 
lyze the statistical properties of the two-state process and the discrete phase. 
Making use of the previous results, in Sect. 4 we obtain expressions for the 
instantaneous output frequency and phase diffusion, as well as for their cycle 
averages. The main conclusions of this work are presented in Sect. 5, and some 
mathematical details are reported in the Appendix. 



2 The two-state model: switching times and definition of the out- 
put discrete phase 

We consider a two-state Markovian stochastic process x a °'*°(t) which only 
takes the values +1 and —1. The notation used emphasizes the fact that at 
an initial instant of time t the system is in the state a , i.e., x a °' to (^o) — a o 
with a = +1 or —1. Due to some physical mechanism (noise in the case of 
a classical system, or the combined action of tunneling and noise in a quan- 
tum problem), there are switches between those two states which are also 
modulated by the action of an external, periodic, time-dependent force with 
period T. The instant of time at which the n-th switch of state takes place is 
a random variable which will be denoted by 7^*°'*°, with n — 1,2.... 
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The analysis of the statistics of switching times T^°' to , can be carried out along 
the lines of the renewal theory detailed by Cox in Ref. [21], with the necessary 
extensions to explicitly time dependent situations. The random variable T"°' to 
will be characterized by its probability density function 



g a ,t 0{t) 



lim 



Prob [t < T«°' t0 <t + At] 
At ' 



or equivalently, by the cumulative distribution function 



G«°> t0 (t) = Prob [T n Q0 '*° < t] = J dt' g%°' to {t'), 

to 



(2) 



or its complementary, 
g%°' t0 (t) = Prob \x 



ao,to 



> t 



(3) 



If we introduce the stochastic process 
N ao ' to (t) = max 



n : T°°> t0 < t 



(4) 



characterizing the number of switches of state in the interval (to,t\, then the 
two-state stochastic process x" '* ^) can De expressed as 



x ao ' to (t) = a cos \irN ao ' to (t) 



(5) 



Taking into account the above expression, we will define a discrete phase 
(p a °' to (t) associated to the two-state stochastic process as 

p«o.*o(t) =7r jV Q0 >*°(i). (Q) 



3 Statistical characterization of the discrete phase Lp a °< to {i) and the 
two-state process x a °' to (t) 



The one-time statistical properties of the discrete phase Lp a °' to (t) can be eval- 
uated from the probability distribution of the number of switches of state 



p%" t0 (t) = Prob \N ao ' to (t) = n 



(7) 
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with n = 0,l,2,.... Making use of the definition of N ao ' to (t) in Eq. (4) it is 
easy to see that 



Prob 



N ao ' to {t) > n 



(8) 



with Gq ' °(t) = 1. Consequently, the probability distribution of the number 
of switches of state and its derivative with respect to t can be expressed, 
respectively, as 



(t) 



G?*(t)-G°$(t) 
= G a n Xi\t)-GT t0 (t), 



(9) 



and 



pT t0 (t) = C M (t) 



(10) 



with =9o 0,10 (*) = 0. 



In order to express the above equation in a more transparent form, it is con- 
venient to introduce the probability of an almost immediate switch of state 
after n switches 



"«*o,*o 



(*) 



lim 



Prob 



t < T n a + °i*° < t + At | N ao > to (t) = n 



At 



as well as the probability of an almost immediate switch of state from state (3 

Prob 



lim 



t<TXX { t )+ i<t + &t\x ao ' to (t)=P 



At 



(12) 



Due to the Markovian character of the stochastic process x a °'*°(£)> ^ 1S clear 
that the rate 7^°'*°(t) is independent of the initial preparation cto at to an d> 
for this reason, henceforth it will be denoted by 7/?(£). Analogously, the rate 
r"°'*°(£) only depends on the value of x ao,t °if) after the n-th switch of state. 
Thus, noting that after an even number of switches of state the system ends 
up in the same state as it was initially, whereas for an odd number of switches 
the system ends up in the other state, it follows that 

TT t0 (t)=la n (t), (13) 



where a n = (— l) n o;o- The time-periodicity of the external force becomes man- 
ifest in the fact that the rate jpit) is also a periodic function of time with the 
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same period T, i.e., 

7/3 (t + T)= 7/3 (t). 



(14) 



Multiplying and dividing the right-hand side of Eq. (11) by p"°'*°(t), assuming 
that the probability of more than one switch of state between t and t + At is 
O [(At) 2 ], and taking into account Eqs. (1) and (13), it is easy to see that 



7a„(t) 



(*)' 



P 



(15) 



Then, from Eq. (10) one obtains the following hierarchy of differential equa- 
tions for p"°' io (t) 



Pn°' t0 (t) = -la n (t)Pn°' t0 (t) + 7a»-i (*)*£'?* (0 &r U > 1, 
Po a °'* (i) = -7aoWPo a0 '*°W, 

which must be solved with the initial condition p® ' to (to) = 8 nj0 . 

We will also introduce the probability of x a °' to (t) to take on the value f3 



(16) 
(17) 



P/3 (tK,t ) = Prob [ X ao ' to (t)=P 

oo oo 



(18) 



n=0 



n=0 



with (3 — 1 or — 1. Notice that in the notation we have made explicit the 
conditional dependence of this probability on the initial preparation. 

Differentiating the above expression with respect to t and taking into account 
Eq. (16), it is straightforward to obtain the master equation for the Markovian 
stochastic process x a °''°(t) 



P(s(t\a ,t ) = -ip(t)pp(t\ao,to) + ^- /3 (t)p- l3 (t\ao,t ), 



(19) 



which must be solved with the initial condition P/3(to\a ,t ) = 5 ao ,p- The 
solution of the above equation can be easily obtained taking into account that 
P-p(t\ao,to) = 1 — Pp(t\oco, to), and the result is 



P(3{t\a ,t ) = 5 a0)f 3 exp 



to 
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+Jdt' 1 _p{t') 

to 



cxp 



dt"~/(t") 



L t> 



where 

7(*)=7+i(*)+7-i(*)- 



(20) 



(21) 



In order to obtain an expression independent of the initial preparation, it is 
necessary to take the limit t — > — oo of Eq. (20) and introduce the long-time 
populations 



z z 

(t)= to lim oo ^(t|ao,*o)= / eft'7_/3(Oexp - j dt" ^t") 



L (' 



(22) 



From the results contained in Appendix A, it follows that the long-time pop- 
ulation pp(t) is a periodic function of t with period T which can be expressed, 
for t E [0,T], as 



T 

P/3 (t) = icsch (^-) J dt'^t') 



x exp 



8gn(f- t')^ - J dt" ^t") 



(23) 



with 7 given by Eq. (A. 5). 



4 The output frequency and the phase diffusion 



The instantaneous output frequency and phase diffusion are, respectively, de- 
fined as [1] 



^(<p ao ' to (t)) = n^(N^(t) 



(24) 



and 



d_ 

dt 



d_ 

dt 



N ao ' to (t)] 2 ^ - (iV ao ' to (t)) 2 | , 



(25) 
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where (. . .) denotes the average with respect to the distribution p^°' to (t), i.e., 



K 



N a ^(t)\) = J2K(n)p^(t), 

n=0 



(26) 



K [N ao,t °(t)} being an arbitrary one-time function of N ao,t °(t). 

Multiplying Eq. (16) by n, summing up the series Y^=\ n Pn°' to (t)i anc ^ taking 
into account Eq. (18), it is easy to obtain that 



*Cr(*) =7r[ 7+ i(t)p + i(f|ao,*o) +7-i(t)p- 1 (t\a ,t )] . 



(27) 



Analogously, if one sums up the series X^li n2 Pn°' to {t) by using Eq. (16), it 
results after some simplifications that 



d_ 

dt 



(28) 



where 



*?*(t) = <Wo E 2np?/%t) + 5^ ao £(2n + l)(%&(t). 



(29) 



n=0 



n=0 



Replacing Eq. (28) into Eq. (25) and taking into account Eqs. (24), (27), and 
(29), it is straightforward to see that 



(30) 



with 



A 7 (*)= 7+1 (t)-7_ 1 (t), 



(31) 



and 



(32) 



Making use of Eqs. (16) and (19) and after some lengthy calculations, it is 
possible to prove that \l/ ao '* (t) satisfies the differential equation 

(i) = _ 7 ( f )*«o,*>( t ) _ J2 Mpit) [pp(t\a ,t )] 2 , (33) 
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with the initial condition fy a °' to (t ) = 0. The above equation can be formally 
solved, yielding 



= - P f dt'^(t') {pp(t'\a ,t )] 2 e W - [ dfjit") 

0=±1 1 [ t> 



(34) 



Inserting Eq. (34) into Eq. (30), one obtains 

Drt tH (t) = vr« t0 (t)-27r 2 A 7 (t) 
t 

£ /?/ ^(0 [^(t'|« ,to)] 2 exp - J dt'^it" 



to 



(35) 



Equations (27) and (35) for the instantaneous output frequency and phase 
diffusion, respectively, still depend on the initial preparation. In order to obtain 
expressions independent on the initial preparation, it is necessary to take the 
limit to — oo. In this limit, one obtains 

Q out (t) = lim QZf°(t) = 7T [ 1+1 (t) P+1 (t) + 7_ 1 (t)p_ 1 (i)] (36) 

to— >— oo 



and 



D out (t) = lim D^f °(t) = nn out (t) - 27r 2 A 7 (t) 

to— »— oo 

t 



x £ J dtVOMOfexp 



/9=±1 J 



^" 7 (t A 



(37) 



The functions fi ou t(£) and D out (t) are periodic functions of the time t (see 
Appendix A). Thus, one can perform a cycle average and define the average 
output frequency 



T T 

fiout = ^ / dtn out (t) = ^Jdt [ 7+1 (t)p +1 (t) + 7 _ 1 (t)p_ 1 (i)] , 



(38) 



and the average phase diffusion 



T T 



Dout = ^ J dt D ont {t) = 7i Q ont - ^csch (J^j £ Pj dt J dt'A^t) 



I3=±l 
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x 7/?(0 MO] 2 exp 



(39) 



where 7 is given by Eq. (A. 5) and we have made use of Eq. (A. 6) with h(t) = 
7/3 (i) \p/3(t)} 2 - Equations (36), (37), (38), and (39), complemented by Eq. (23), 
are the main results of this work. 



5 Concluding remarks 



In this paper, we have put forward a Markovian two-state theory to describe 
the phenomenon of frequency and phase synchronization in noisy systems 
driven by deterministic time-periodic forces. The fundamentals of our strategy 
are based on an extension of the renewal theory to time- dependent situations. 
We have obtained explicit expressions for the instantaneous output frequency 
and phase diffusion, as well as for their cycle averages. These expressions, 
which are completely determined by the rates of escape from both states, 
are quite general and should apply to realistic situations with two metastable 
configurations. Thus, they represent a convenient starting point for the study 
of the frequency and phase synchronization in a wide range of situations. 
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A Some mathematical details 



The aim of this Appendix is to analyze some interesting properties of integrals 
of the form 



H(t)= / dt' h(t') exp 



(A.l) 



with h(t) being a periodic function of t with period T. Examples of integral 
of this type are those appearing in Eqs. (22) and (37). 
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First, we will prove that H(t) is also a periodic function of t with the same 
period T as the functions h(t) and 7(i). In order to do so, let us consider its 
value at t + T, 



t+T 



H(t + T)= J dt' h{t') exp 



t+T 



(A.2) 



After making the change of variables t' — t' — T and t" — t" — T and using 
the periodicity of the functions h(t) and "f(t), it is straightforward to see that 
H{t + T) = H{t). 

Once that the periodicity of H(t) has been proved, it is possible to express 
H(t) in a more compact form which does not involve an improper integral. To 
do so, let us split the integral in Eq. (A.l) into the two pieces 



H(t) = if (0) exp 



-Jdt'-f(t') + J dt' h{t') exp -Jdt"~i(t" 



. (A.3) 



Setting t = T in the above expression and taking into account that H(T) = 
H(0), it follows that 



H(0) = -^-^ J dt' h(t') exp / dt" 7 (t" 



(A.4) 



with 



T 

1 = \\ dt^t). 



(A.5) 



Then, inserting Eq. (A.4) into Eq. (A.3), one obtains after some simplifications 
that 



H(t) = icsch {^-) I df'h(t') exp 



(A.6) 



for t E [0,T]. 
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